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Abstract. In a previous work we introduced an elementary method to analyze the peri- 
odicity of a generating function defined by a single equation y — G(x, y). This was based 
on deriving a single set-equation Y = T(Y) defining the spectrum of the generating func- 
tion. This paper focuses on extending the analysis of periodicity to generating functions 
defined by a system of equations y = G(x, y). 

The final section looks at periodicity results for the spectra of monadic second-order 
classes whose spectrum is determined by an equational specification — an observation of 
Compton shows that monadic-second order classes of trees have this property. This 
section concludes with a substantial simplification of the proofs in the 2003 foundational 
paper on spectra by Gurevich and Shelah [IB], namely new proofs are given of: (1) every 
monadic second-order class of m-colored functional digraphs is eventually periodic, and 
(2) the monadic second-order theory of finite trees is decidable. 



1. Introduction 

Following Flajolet and Sedgewick |15j . a combinatorial class A is a class of objects with 
a function || || that assigns a positive integer size to each object in the class, satisfying 
the condition that there are only finitely many objects of each size. We deviate from the 
definition in [15] by not having objects of size 0. Letting a{n) be the number of objects of 

oo 

size re, one has the generating function A(x) = a{n)x n . 

n=l 

1.1. Generating Functions denned by Systems of Equations. Cayley [7] noted in 
his very first paper on treea^in 1857 that one has an equation 

^a(re)x n = x ■ Y[(l - x n )- a(n) 

n>l n>l 

which yields a recursive procedure to calculate the values of a(re). Cayley used this to 
calculate the first 13 coefficients a(n), that is, the numbers of such trees of sizes 1 through 
13 (two of the numbers were not calculated correc tly)fl In 1937 Polya (see [E]) would 

Date: November 13, 2009. 

^Unless stated otherwise, all trees in this paper are assumed to be rooted. 

2 Actually, as noted in pQ, Cayley's equation was slightly different since his o(n) counted the number of 
trees with n edges, which is the number of trees with n + 1 vertices. 
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rewrite this equation as 

/ oo n 

A(x) = x ■ exp 



\m=l 



a form which could be viewed as a functional equation for A(x), with important analytic 
properties based on the fact that the radius of convergence p of A{x) is less than 1 (which 
is easily proved) . This allowed Polya to invoke the implicit function theorem and results of 
Darboux to show that A{x) has a square-root singularity at p, leading to the asymptotic 
form C p~ n n~^l 2 for the coefficients a(n)J^] Many natural classes of trees are specified 
recursively by a single equation, for example planar binary trees, also known as (0, 2)- 
trees, where the generating function A{x) solves the equation y = x(l + y 2 ). 

Although generating functions defined by a single equation cover many interesting cases, 



Example 33 at the end of the introduction section, hints at the value of considering gen- 



erating functions defined by a system of several equations. 



1.2. Spectra and Periodicity. In 1952 the Journal of Symbolic Logic initiated a section 
devoted to unsolved problems in the field of symbolic logic. The first problem, posed 
by Heinrich Scholz [2D], was the following. Given a sentence p from first-order logic, he 
defined the spectrum of ip to be the set of sizes of the finite models of p. For example, 
binary trees can be defined by such a <p, and its spectrum is the arithmetical progression 
{1, 3, 5, . . .}. The algebraic structures called fields can also be defined by such a p, with the 
spectrum being the set {2, 4, . . . , 3, 9, . . .} of powers of prime numbers. The possibilities 
for the spectrum of a first-order sentence are amazingly complex]^] 

Scholz's problem was to find a necessary and sufficient condition for a set S of natural 
numbers to be the spectrum of some first-order sentence p. This problem led to a great 
deal of research by logicians on the topic of spectra — see for example the recent survey 
paper [13] of Durand, Jones, Makowsky, and More. Periodicity is one of the properties 
that has been examined in the context of studying spectra. 

Definition 1. N is the set of non-negative integers, F is the set of positive integers. 
For iCN, 



In [T] we showed that a similar analysis can be carried out for most A(x) defined by a single non-linear 
equation y — O(y) where Q is constructed from the variables x,y, operations +, and unary operators 
that correspond to (restrictions of) the standard constructions of Multiset, Sequence and (directed or 
undirected) Cycle. 

4 Asser's 1955 conjecture, that the complement of a first-order spectrum is always going to be a first- order 
spectrum, is still open — it is known, through the work of Jones and Selman and Fagin in the 1970s, that 
this conjecture is equivalent to the question of whether the complexity class NE of problems decidable by 
a nondeterministic machine in exponential time is closed under complement. Thus, Asser's conjecture is, 
in fact, one of the notoriously hard questions of computational complexity theory. Stockmeyer 22 , p. 33, 
states that if Asser's conjecture is false then NP 7^ co-NP, and hence P 7^ NP. 



SPECTRA AND SYSTEMS OF EQUATIONS 



3 



(a) A is periodic if there is a positive integer p such that p + A C A, that is, a £ A 
implies p + a £ A. Such an integer p is a period of A. 

(b) A is eventually periodic if there is a positive integer p such that p + A is eventually 
in A, that is, there is an m such that for a £ A, if a > m then p + a £ A. Such a p 
is an eventual period of A. 

Clearly every arithmetical progression and every cofinite subset of N is periodic; and every 
periodic set is eventually periodic. Finite sets are eventually periodic. As will be seen, 
periodicity seems to be a natural property for the spectra of combinatorial classes specified 
by a system of equations. The famous Skolem-Mahler-Leech Theorem (see, for example, 
[15], p. 266) says that the spectrum of every rational function P(x)/Q(x) in Q(x) is eventu- 
ally periodic. Consequently polynomial systems y = G(x, y) with rational coefficients that 
are linear in the variables yi, and with a non-singular Jacobian matrix <9(y — G)/dy, have 
power series solutions yi = Ti(x) such that the support sets of the coefficient sequences tj(n) 
of the T{(x) are eventually periodic. However, much simpler methods give this periodicity 
result for the non-negative y-linear systems considered in this paper. 

If the spectrum A of a combinatorial class A is eventually periodic then one has the 
possibility, as in the case of regular languages and well-behaved irreducible systems, that 
the class A decomposes into a finite subclass Aq, along with finitely many subclasses Ai, 
such that the spectrums Ai are arithmetical progressions ai + bi ■ N, and the generating 
functions Ai(x) have well-behaved coefficients (e.g., monotone increasing) on Ai^ 

In the study of spectra of combinatorial classes, logicians have dominated the literature 
thanks to powerful tools like Ehrenfeucht-Frai'sse games. In this paper an alternate ap- 
proach to the spectra of combinatorial classes is developed using systems of set-equations 
derived directly from specifications, or from systems of equations defining generating func- 
tions. This method was briefly introduced in 2006 in [1, to study the spectrum of a 
combinatorial class defined by a single equation. For example, the class of planar binary 
trees is specified by the equation T = {•} U {•}/Seq 2 (T), which one can read as: the 
class of planar binary trees is the smallest class T which has the one-element tree ' and 
is closed under taking any sequence of two trees and adjoining a new root ' . From the 
specification equation the generating function T(x) of T satisfies T(x) = x + x • T(x) 2 , 
a simple quadratic equation that can be solved for T(x). One also says that T(x) is a 
solution to the polynomial equation y = x + x ■ y 1 . For the spectrum T of T one has 
the equation T = 1 U (1 + 2* T), so T satisfies the set-equation Y = 1 U (1 + 2 * Y). 
(See ^2] for the notation used here.) Solving this set-equation gives the periodic spectrum 
T= 1 + 2-N. 

There were two stages in our study p~| of a single equation. The first looked at y = G(x, y) 
where G(x, y) was a power series with non-negative coefficients. The second looked at more 



The comments in this paragraph are related to Question 7.4 in Compton's 1989 paper [8] on monadic 
second order logical limit laws. 
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complex equations y = &(y) involving operators like Multiset, Sequence and Cycle. The 
same two stages will be followed in this study of generating functions defined by systems 
of equations. 



2. Set Operations and Periodicity 



2.1. Set operations. The calculus of set-equations (for sets of non-negative integers) 
developed in this section uses the operations of union (U, (J), addition (+), multiplication 
(•) and star (*), where: 

Definition 2. For A, B C N and n G N let 

A + B := {a + b : a G A, b G B} 



n-B := 



n-k B 



A*B 



{nb : b G} 


B + --- + B 

S v ' 

n copies of B 

\J a*B 

aeA 



for n = 
for n > 



The values of these operations when an argument is the empty set are: + A = A+0 = 0, 
71-0 = 0, 0*5 = 0, and ,4*0 = if OG A, otherwise A * = 0. 

The obvious definition of A • B is not needed in this study of spectra; only the special case 
n ■ B plays a role. The next lemma gives the basic identities regarding U, +,* needed for 
this analysis of spectra (all are easily proved). 

Lemma 3. For i,B,CCI and m, n G N 

A + {BUC) = {A + B)U{A + C) 

n-k (A + B) = n-k A + n-k B 

(A + B)kC = AkC + BkC 

m-k(n-kB) = (m • n) * B 

(AuB)kC = AkCiJBkC 

Ak(BuC) = (J j l *B + j 2 -kC. 

J1J2GN 



2.2. Periodic and eventually periodic sets. The following characterizations of periodic 
and eventually periodic sets are easily proved, if not well known. 

Lemma 4. Let A C N. 



SPECTRA AND SYSTEMS OF EQUATIONS 5 

(a) A is periodic iff there is a finite set A\ C N and a positive integer p (called a period 
for A) such that 

A = A\ +p • N 

iff A is the union of finitely many arithmetical progressions. 

(b) (Durand, Fagin, Loescher [12]; Gurevich and Shelah (16] ) A is eventually periodic iff 
there are finite sets Aq, A\ C N and a positive integer p (called an eventual period of 
A) such that 

A = A U (Ai + p ■ N) 
iff A is the union of a finite set and finitely many arithmetical progressions. 

Remark 5. An infinite union of arithmetical progressions need not be eventually periodic. 
Let U be the union of the arithmetical progressions a ■ F, where a is a composite number. 
Then U consists of all composite numbers. 

Given any positive integer p, choose a prime number q that does not divide p. Then by 
Dirichlet's theorem the arithmetical progression q 2 +p-N has an infinite number of primes, 
so q 2 + p ■ N is not a subset of U. Since q 2 G U, it follows that p is not an eventual period 
for U (one can choose q arbitrarily large). Thus U is not eventually periodic. 

Lemma 6. Suppose A,B,C C N are [eventually] periodic. Then each of the following are 
[eventually] periodic: 

(a) A U B 

(b) A + B 

(c) A*B. 

In (c), if A is periodic and B is eventually periodic, then A-k B is actually periodic. 

Proof. Parts (a) and (b) follow easily from Lemma [4] and Lemma [3j (The eventually 
periodic case is discussed in [15].) 

For the eventually periodic case of (c), choose positive integers p, q so that p+A is eventually 
in A and q + B is eventually in B, and use Lemma [4] to express each of A and B as the 
union of a finite set and finitely many arithmetical progressions, say A = Aq U (A\ + r • N) 
and5 = J B U(Si + s-N). 

Starting with 

A*B = A Q *B U (Ai + r • N) *B, 
from ([T]), examine the two parts of the right side. For Aq ★ B, using Lemma [3] 

Ao*B = \J j*(B Q U (Bi + s-N)) 

|J j *B + j 1 *(B 1 + s-n) byQ 
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U h*B | u 



\ 



U io*^o + Ji*5i+jis-N 



by @, 



/ 



a union of finitely many eventually periodic sets, hence eventually periodic by (a). 
For (A\ -+- r ■ N) * B, choose b £ B. Then, again using Lemma [3] 
(Ai + r-N)*^ D (Ai+r + r-N)*5 

= r * B + (Ai + r • N) * B by (0 

D r&+ (Ai + r • N) *B. 

Thus (Ai + r ■ N) * B is actually periodic. This shows A ★ S is a union of two eventually 
periodic sets, hence it is also eventually periodic. 

For item (c), note that A is periodic means we can assume Aq = 0. Then the argument 
for the second part above shows that A is also periodic. 

□ 

2.3. Periodicity parameters. For A C N, for n G N, define 



A - n 
gcd(O) 
m(0) := min(0) 



{a — n : a £ A} 


oo. 



The next definition gives some important parameters for the study of periodicity. 
Definition 7 (Periodicity parameters). For an eventually periodic set iCF}, A ^ 0, let 

(a) m(A) := mm(A) 

(b) q(A) :=gcd(A-m(A)) 

(c) p(A) is t/ie minimum of the eventual periods p if A is infinite; otherwise it is 0. 

(d) c(A) is the first element k where p(A) becomes a period for A n [fe, oo). 

The following table gives the calculations of m and q on combinations of non-empty sets 
using the operations U, +,*. 

Propositions. LetA\,A2 CN be non-empty and eventually periodic, with mi :=m(Aj),qj : 
q(Aj) ; fori = 1,2. Then 

Set m q 



Ai U A 2 
Ai + A 2 

Ai * A 2 



min(mi,m 2 ) 
nti + m 2 

mim 2 



gcd(qi,q 2 ,m 2 - mi) 
gcd(qi,q 2 ) 

fo i/A 1 = 

| gcd(q 2 , qim 2 ) if Ax / 0. 
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Proof. The calculations for m are clear in each case. 
Let a G N, U, V C N. Then 

OeU + V =► gcd(U + V) =gcd(gcd([/),gcd(y)) 

a > £ V => gcd(a*V) = gcd(V). 

For := U Let m := tn(-A), q := q(A), and suppose, without loss of generality, that 
rtti < rtt2. Then m = mi, so 

q = gcd ((j4i - mi) U (A 2 - mi)) = gcd (gcd(Ai - mi),gcd(A 2 - mi)) 

= gcd ^i,gcd(^ 2 - m 2 + m 2 - mi)) = gcd (<?i,gcd (gcd(A 2 - m 2 ),m 2 - mi))) 
= gcd (<?i,gcd (g 2 ,m 2 - mi))) = gcd (91, q 2 , m 2 - mi)) . 

For A := A l + A 2 : Let m := m(A), q := q(A). Then 

q := gcd(^l-m) = gcd(^(Ai -mi) + (A 2 -m 2 )) 

= gcd (gcd(Ai - mi), gcd(yl 2 - m 2 )) = gcd (91,92) ■ 

For A := Ai*A 2 : Let m := m(A), q := q(A). If A\ = then A = 0, so q = 0. Now suppose 
A x ^ 0. Then 

q := gcd (A - m) 

= gcd [Ai *A 2 - mim 2 ) 

= gcd ( |J ai ★ v4 2 - mim 2 ) 

ai6Ai 



= gcd( |J ai * (A 2 - m 2 ) + (ai - mi)m 2 ) 

016A1 

= gcd{gcd(gcd(ai*(A 2 -m 2 )), (ai -mi)m 2 ) : ai G A^ 

= gcd{gcd(gcd(ai*(A 2 -m 2 )), (ai - mi)m 2 ) : a x G Ai, a x / o| 

= gcd I gcd (q 2 , (ai - mi)m 2 ) : ai G Ai, ai / o| 

= gcd (q 2 , gcd ((^1 - mi)m 2 )) 

= gcd (q 2 , qim 2 ). 



□ 



Definition 9. For iCN and c G N let A\> c := An [c, 00). Likewise define A\ >c , A\< c , 
and A\ <c . 
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The next result concerns one of the best known examples of periodic sets, namely in 
the study of the Postage Stamp Problem, also known as the Coin Problem (see Example 
28). 

Lemma 10. Suppose BCN and Let A = N*B, and let c := c(A), p := p(A), 

q := q(A). Then 

(a) A is periodic, 

(b) p = q = gcd(A) = gcd(.B), and 

(c) A = A\ <c U (c + q-N) C q • N. 

Proof. (See, e.g., Wilf [23], §3.15, for a popular proof based on analyzing the asymptotics for 
the coefficients of a generating function via partial fractions over C — this method originated 
with Sylvester.) □ 

Lemma 11. Suppose A is eventually periodic. Letting c := c(A), q := q(A), p := p(A), 
one has the following. 

(a) (Gurevich and Shelah |16| . Cor. 3.3) The set of eventual periods of A is p ■ P. 

(b) q | p, and p = q iff p I A — m. 

(c) A can be expressed as the union of a finite set and a single arithmetical progression 
iff p = q ■ (A\> c ). 

(d) If the condition of (c) holds then one has A = A\ <c U (c + p • N). 

Proof. The proof of (a) in [16] is elementary, as are the following proofs for (b)-(d). Let 

n := lim #([n,n + p - 1] n A). 

n is well-defined since A is eventually a union of arithmetical progressions by Lemma |4| 
So for n of the same p-equvalence class the sequence stabilizes, and thus the count on the 
right side stabilizes. 

(b) : First we show q | p. If ^4 is finite then the proof is immediate since p = 0. 

Now assume A is not finite. Take a £ A large enough that by the eventual periodicity 
a + p G A. Then q | a — m and q | a + p — m. Thus q divides their difference, so q | p. 

Clearly p = q implies p | (A — m) since q | (A — m). Conversely, if p | (A — m) then p | q = 
gcd(A — m); and since q | p one has p = q. 

(c) and (d): A is eventually a single arithmetical progression iff n = 1. 

Suppose n = 1, then since the series defining n is a nondecreasing series of integers on A\> c 
it must always be or 1. Thus A\> c is precisely a single arithmetical progression giving (d). 
Further the q of a single arithmetical progression is exactly the period. Thus q(A|> c ) = p 
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Suppose #([n, n + p — 1] n A) > 1 for some n > c. Then taking the difference of two 
elements in this range one has q(^4|> c ) < p. 

□ 

Given A C N and a positive integer n, let [A] n be the set of integers modulo n, so [A] n 
is a subset of Z n , the additive group of integers modulo n. Let A n be a set of integers in 
{0, 1, . . . , n - 1} such that [A n ] n = [A] n . 

Lemma 12. Suppose A C N is periodic. Let p := p(A). 

(a) For m sufficiently large, 

A \> pm = {pm + A p )+p-N. 

(b) If [A]p is a subgroup of Z p then p = q, and for m sufficiently large, 

A\. = pm + p • N. 

\>pm r r 

Proof. For (a), note that if j £ Ap then there is an a £ A such that a = j mod p. Let p be 
a period for A. Then a + p ■ N C A. Now a + pn is eventually > c, and a + pn = j mod p 
(since p | p). Thus for j G ^4 p there is an a 6 i such that a = j mod p, and a + p • N C A. 
Writing a = j + pmj, let m = max (mj : j G A p ) . Then 

^l> pm = (p™ + ^ P )+P-N 

For item (b), let [g]p be a generator for the subgroup [A] p , where < g < p. Then 

A p = {0,g,...,(r-l)g}, 
where r is the order of [g]p in Z p . By (a), for a sufficiently large choice of m one has 

A \> pm = prn + {0,g,...,(r-l)g}+p-N. 

If <7 > then g\p. From this one has 

A \> pm = pm + {0,g,...,(r-l)g}+p-N 
= pm + g ■ N, 

contradicting the fact that p is the smallest eventual period of A. 
Thus g = 0, which leads to p | A and 

AL = pm + p • N. 

I>pm r r 



From p | A one has p | A — m, and thus p = q, by Lemma 11 (b). 

□ 
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The next lemma augments the results of Lemma 11 (c),(d), giving a simple condition that 
is sufficient to guarantee that A is a periodic set involving a single arithmetical progression. 
This is used in the study of non-linear systems defining generating functions. 

Lemma 13. Suppose A C N with AflP / 0, and suppose there are integers r > and 
s > 2 such that 

A D r + s-kA. 

Let c := c(A), m := m(A), p := p(A) and q := c\(A). Then A is a periodic set, p = q, and 

A = vl| <c U(c + p-N). 



Proof. Choose t G (s — 1) * A. Then A D r + t + A, so A is periodic. 

Next let B := A — m, a subset of N with in it (since m £ A). Furthermore B is periodic 
and p(B) = p, q(B) = q. Letting b = r + (s — l)m, 

£? = ^4 — m 5 r + s*A — m, 

so 

5 5 b + s*B. 

Since £ B and s > 2, 

B^ b + B and £ D b + B + B. 

From this one easily derives 

B D bp + B + B, 
so reducing modulo p, 

[B] p D [B] p + [B] p . 

This means [B]p is a subgroup of Z p , so, by Lemma [l2|(b), p = q, and for m sufficiently 
large, 

BL = pm + p • N, 

l>pm r r ' 



which gives 

But then, by Lemma [TT| (d), A = A\ <c U (c + p • N). 



AL . = m + pm + p • N. 

I>m+pm r r 



□ 
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3. Systems of Set-Equations 

We will consider systems of set-equations of the form 

Y 1 = T x {Y x ,...,Y k ) 

Y k = r fc (y 1 ,...,y fc ), 

written compactly as Y = T(Y), with the Tj(Y) having a particular form, namely 

(1) r;(Y) = (J r ijU + iti*y 1 + --. + « Jfe *y fc , 

uGN fc 

where the Tj iU are subsets of N. The system of equations ([I]) is simply expressed by 

(2) r(Y) = (J r u + u*Y, 

ueN fe 

where u * Y := u% * Y\ H V u k * Y k . 

3.1. TDom and rDom . 

Definition 14. Let rDom be the set o/T(Y) of the form and let TDomo be the set of 
r(Y) G rDom which map Su(P) fc into itself. A system Y = T(Y) of set-equations is basic 
i/r(Y) G rDom . 

Lemma 15. Suppose T(Y) G rDom. Then 

(a) for A G Su(N) fc one has 

T l (A) = [J (r 4iU + Uj*^), 

u£N fc {j:« J >0} 

where the summation term is omitted in the case that all Uj = 0. 

(b) A G Su(P) fc and G u * A irapZy u = 0. 

(c) r(Y) G TDomo iff T G Su(P) fc . 

Proof, (a) follows from the fact that * Aj = 0, by Definition [2j 

Given A G Su(P) fc , (b) follows fr om 

G u * A 44> £ Uj+i; for 1 < i < k 
Ui = for 1 < i < k, 
the last assertion holding because ^ Ai for any i, and Definition [2j 
For (c), let A G Su(P) fc . Then 

r(A) C Su(P) fc £ T 4 (A) for 1 < i < k 
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& i r ijU + u * A for 1 < i < k, u G N fc 
i r i;U n u * A for 1 < i < k, u G N fe 

4^ (oeuiA^O^ r i)U ) for 1 < t < Jfe, u G N fc 
4^ ^ I\ for 1 < i < k, 
the last line by item (b). □ 

Define a partial ordering < on rDom by 

T(Y) < A(Y) iff r ijU C A i)U for all i, u. 

p( n )^Y) denotes the n-fold composition of T(Y) with itself, and (Y) is the ith compo- 
nent of this composition. Let r (oo) (Y) := U„>o rW ( Y )- For A,B G Su(N) fc let, 

• min A := (min Ax, ■ ■ ■ , min ^4^) 

• A < B expresses Ai C Bi for 1 < i < k 

• AT (A) := {i:A i = 0}. 

Lemma 16. Given T(Y) G TDom, and A, B G Su(N) fc , the following hold: 

(a) A < B => r(A) <T(B) 

(b) Af(A) = jV(B) AA(r(A)) = A/"(r(A)) 

(c) A<B jV(r(A)) DAT(r(B)) 

(d) AT(rW(0)) = AA(r( fe+n )(0)) /orn > 0. 

Proof. Item (a) follows from the montonicity of the set operations |J, +,* used in the 
definition of the T(Y) in TDom. 

Next observe that 

(3) jV(r(A)) = li : (Vu G N fc ) (r i)U = or (3j) ( Uj > and Aj = 0)) J, 

since from ^ one has i G JV(r(A)) iff for every u G N fc one has rj iU + u ★ A = 0, and 
this holds iff for every u G N k one has either Ti u = 0, or for some j, Uj * Aj = 0. Note 
that uj * Aj = holds iff Uj > and Aj = 0. 

Item (b) is immediate from (|3j). 

To prove (c), note that Bj = => Aj = 0, and then use 

To prove (d), note that from < T(0) and (a) one has an increasing sequence 

<r(0) <r( 2 )(0) < ••• . 
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Then (c) gives the decreasing sequence 

{i,...,k} = M{&) 5 Af(r(0)) 5 AA(r( 2 )(0)) d .... 

From (b) one sees that once two consecutive members of this sequence are equal, then all 
members further along in the sequence are equal to them. This shows the sequence must 
stabilize by the term AA(r (fc) (0)). □ 

For the next lemma, recall that min(0) := +oo. 

Lemma 17. Suppose T 6 rDomo, and suppose A C Su(P) fc with A < T(A). Then 

mmr^(A) = minrW(A). 
In particular, m.mF^ oo \0) = minr^ (0). 

Proof. From 

r(Y) : = [j r u + u*Y 

ueN k 

one has, by Lemma 15 (a), for 1 < i < k, 

rf +1) (A) = |J (r, u + £ Uj ^f(A)). 

ueN fc {j:uj>0} 

Let 

b u := minr u (A) 
: = minl^A), 

that is, for 1 < i < k, 

b i<u = minr iiU (A) 
b\ n) := minr ( ^(A). 

Then for n > 0, 

(4) b( n+1 )<b», 

since A < T(A) implies T^ n ^(A) < r^ n+1 ^(A), by repeated application of Lemma 
From the above, 

b[ n+1) := minr ( ; i+1) (A) 

= min |J (r liU + %* r ?( A )) b y0. 

uSN fc {j:uj>0} 

so 

(5) bt +1) = min {b i>u + «i 6 J° :u e4 

{j-.ujX)} 
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For n > 1 let 

(6) In := {r-bf ] <bf- 1) ). 
CLAIM: 

(Vn > l)(Vi G I n+ i)(3r G /„)(\ { " +1) > &< n >). 
Proof of Claim. Suppose n > 1 and i G /n+i, that is, 

From ([5]), let u G N fc be such that 

(7) ht +i) = k, u+ y: 

{j:uj>0} 

Let r G {1, . . . , k} be such that u r > and r G / n — such an r must exist, for otherwise 
Uj > would imply j ^ / n , that is, bj = bj 1 ^. Then from ([7]), and from ([5]) with n — I 
substituted for n, 



{j:uj>0} 



contradicting the assumption that i G I n , that is, 6^ n+1 ^ < b\ n \ 
For this choice of u and r, Q implies 

(8) > 6^, 

establishing the Claim. □ 



Now suppose I n 7^ for some n > A; + 1. Then, by the Claim, one can choose a sequence 
i n , . . . , i n _fc of indices from {1, . . . , k] such that 

(9) fc (n) > > • • • > bf~ k) 

K ' L n l n — l ln — k 

and ij G for n — k < j < n. By the pigeonhole principle there are two j such that the 

indices ij are the same, say r = i p = i q , where n — k < p < q < n. Then bft > 6^ by 

But from r G Iq and Q one has 6^ < ft^ < ••• < bi p \ giving a contradiction. Thus 
I n = for n > k, completing the proof of the lemma. □ 
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3.2. The Minimum Solution of Y = T(Y). 

Proposition 18. For T(Y) E rDom, the system of set-equations Y = T(Y) has a mini- 
mum solution S, and it is given by 



r(°°)(0) : = (Jr^(0). 



n>0 



// r(Y) E TDomo tfien, for\<i<k, one has S { = ijf T ( f (0) = 0. 



Proof. The sequence of sets T^ n \0) is non-decreasing by Lemma 16(a) since C T(0). 
Suppose a G T °° (0). Then, for some n > 1, 

(10) aGr { " } (0) = r^* -1 ^)) c r,(r(°°)(0)). 
This implies r (oo) (0) < r(r (oo) (0)). 

Conversely, suppose a G Tj (r*- oo - ) (0)) . Then for some u G N fc , 

(11) aGr iiU + u*r(°°)(0), 

which in turn implies for some u G N k and n > 1, 

(12) aeii, u + u*r( n )(0) c r( n+1 )(0) c r(°°)(0). 

Thus r (oo) (0) = r(r (oo) (0)), so r (oo) (0) is indeed a solution to Y = T(Y). 



Now, given any solution T, from < T and Lemma 16(a) it follows that for n > 0, 
T (n) (0) C T (n) (T) = T, and thus r (oo) (0) C T, showing that r (oo) (0) is the smallest 
solution to Y = T(Y). 



The test for Sj = is immediate from Lemma 17 



□ 

3.3. The Dependency Digraph for Y = T(Y). In the study of systems Y = T(Y) 
with T(Y) G rDom, it is important to know when Yi depends on Yj. This information is 
succinctly collected in the dependency digraph of the system. 

Definition 19. The dependency digraph D of a system Y = T(Y) (with k equations) has 
vertices l,...,k and directed edges given by i — > j iff there is a u G N fe such that Tj )U ^ 
and Uj > 0. 

The dependency matrix M of the system is the matrix of the digraph D. 

Ifi—>j G D then we say "i depends on j", as well as "Yi depends on Yj". The transitive 
closure of — » is ; the notation i — > + j is read: "i eventually depends on j". It asserts 
that there is a directed path in D from i to j. In this case one also says "Yi eventually 
depends on Yj". The reflexive and transitive closure of — > is — ►*. 
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For each vertex i let [i] denote the (possibly empty) strong component ofi in the dependency 
digraph, that is, 

[i] := {j :i^ + j i}. 

For a given system Y = T(Y), the following are easily seen to be equivalent: 

(a) i ^+ j 

(b) there is an n G {1, . . . , k} such that (M n )ij = 1. 

(c) the (i,j) entry of M H h M n is not 0. 

3.4. The Main Theorem on Set Equations. Recall that u * Y means u± * Y\ + ■ ■ ■ + 
Uk*Yk; and T u + u ★ Y is the fc-tuple obtained by adding u * Y to each component of 

r 

It is well-known that (Su(N) fc ,(i) is a complete metric space, where 

(Vmin |Ji = i (AiABi) - f . / R 

d(A, B) := ^ UA^h5 
[0 ifA = B. 

In this space lim d(A n , B n ) = iff for every m there is an N such that ^4 n | <m = B n \ <m 
for n> N. 

When the minimum solution S of a basic system Y = T(Y) is meant to give spectra 
Si of generating functions, then is excluded from the Si, so one has the condition ^ 
T^o, 1 < i < k. Also one can assume that trivial equations Y; L = Yj have, after suitable 
substitutions into the other equations, been set aside. Thus one can assume there are no 
terms rj )U + u* Y which are simply a variable Yj. Both restrictions on T(Y) are captured 
in the definition of elementary systems of set-equations. 

Definition 20. A basic system Y = T(Y) of set-equations is an elementary system if it 
satisfies 

k 

e r i)U => ^2uj>2 forl<i<k,ue Su(N) fc . 
i=i 

If it also satisfies J\f (Y l - k \&)) = 0, that is, no coordinate ofY^ k \@) is the empty set, then 
one has a reduced elementary system. 

If Y = T(Y) is a non-reduced elementary system, then a simple process of reduction 
allows one to eliminate the Yi for which i £ J\f(T^ k \0), namely by substituting for all 
occurrences of such Yi in T(Y), and removing the equations with such Yi on the left side. 
The resulting system will be reduced elementary. 



Theorem 21. Let Y = T(Y) be an elementary system of k set-equations. Then the 
following hold: 
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(a) There is a unique solution T G Su(P) fc , and it is given by 

T = r (oo) (A) := lim ]S n )(A), for any A G Su(P) fc . 

n^oo 

(b) t = #f r ( f (0) = 0, f/tai is, i e M(r^{0)). 

For the remaining items, we assume the system is reduced. 

(c) [i] implies Ti is periodic. If also there is a j G [i] such that for some u G N fe 
one has Tj <u ^ and J2i u e '■ ^ ^ HI — 2, i/ien Tj is the union of a finite set with a 
single arithmetical progression. 

(d) Suppose [i] = and the ith equation can be written in the form 

k 



Yi : I', ■ (J E^* y i 

QeQi j=i 



with Pi [eventually] periodic, and with £3j a finite set of k-tuples Q = (Qi, ■ ■ ■ , Qk) 
of [eventually] periodic subsets Qj o/N, and for i — » j one has Tj being [eventually] 
periodic. Then Ti is [eventually] periodic. 

(e) The periodicity parameters m, q of the solution T can be found from r^(0) and the 
T u via the formulas: 

(13) mi'-miiTi) = min (r ( J } (0)) 

(14) m--c\(Ti) = gcdf |J J (r Au + u*m-Tlv)V 

^ u£N fc ' 

(f) qi | c\j whenever i — > j. 

Proof. The mapping T : Su(N) fc — > Su(N) fc is a contraction map on the complete metric 
space (Su(N) fc ,d), proving (a). Item (b) follows from Proposition 



18 



Now we are assuming that the system is reduced. For (c), first note that given i and u 
such that Ti^ u / 0, there is a q > (any q G Fj iU ) such that 

T; 5 ?+ ^ Uj-kTj. 

From this, % — > j implies Tj D p + Tj for some positive p, hence 

i ^ + j implies Tj 5 P + Tj for some positive p. 

Now suppose [i] 7^ 0. Then z i, so Ti 3 jj-f- Tj for some positive p, that is, Tj is 
periodic. 
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For the second part of (c), one can assume that — ► equals — > + (by using T U • • • U in 
place of r). From i —* j follows Tj D Pi + Tj for some positive pi. The hypothesis of (c) 
gives Tj D p2 + T a + Tb for some a, 6 (possibly equal) and some p2 > 0. Finally a — > i and 
6 — > i show that T a D ^3 + Tj and 5 P4 + T for positive p%, p&. With p = pi +f>2 +P3 +£>4 
one has T 5 P + 2 *Tj. Then Lemma 13 gives the desired conclusion. For (d), just apply 
Lemma [6] 



Now to prove (e) and (f). The expression (13) for mj is given in Lemma 17 



so it remains 



to derive the formula (14) for q,. T is the unique solution to the system, so 

T = |J (r u + u*T). 



Letting S = T — tn, one has in each Sj and 

S = |J (r u + u*m-m + u*s), 



uer 



or in terms of the individual components Sj one has, 



Sj = [J ( r iiU + (^2u t miJ -xtij + ^2u e -kSi j. 
ueN fc ^ i=i ' 1=1 ' 



For 1 < j < k let 



Rj,u ■- 



U ( r J> + ( UlXni ) - m i ) ' 

ueN fc V t=i ' ' 



so 

k 

(15) Sj = U (Rj,u + J2 u e* S e] 

ueN fe i=i 

Since E ut* Sg for all £, one has for 1 < j < k and u £ 

(16) .v ; 5 Rj,u- 



By definition, % = gcd(Sj), so (16) implies 
(17) q, 



Ri.u- 



For i —* j there is a u 6 such that Tj.u 7^ 0. Then (15) and (17) imply that 
(18) qi j Sj whenever i — > j, 

since q^ \Si, and since whenever Tj iU 7^ one has Si D -Rj,u + Sj. This proves item (f) of 
the theorem. From (15) and (18) 



(19) 



Rj,u- 
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From ([17]) and ([19]) 

(20) 



q* := gcd( |J Rj, u \ 



To show q*| qij from T = r (oo) (0), one has S = n(°°)(0), where 

Q : Ah l^j r u -m + u*m + u*A = R u + u*A. 

uSN fe 

One proves, by induction on n, that 
Ground Case: (n=l) 



%(0) = -Rj, u so q* %(0) if i — >■* j, by the definition of q* in ( |20| ). 
Induction Step: 



Assume that q\ 



n ( f{0) if i — >* j . One has 



uer 



Suppose that i — >■* j. Then I Rj u (by the definition of q* in (20)). For u G N fc , clearly 



(21) 



R 



=> q* 



i? ilU + 5>^*O ( ?(0) 



0. 



If u G N fc is such that Rj u / 0, let u m > 0. Then j — > m, and since i —>■* j, one has i —>■* m. 



By the induction hypothesis this implies q* 
and one knows q* | Rj, u - Thus 



^(0). Consequently q* I *Q ( ;"(0), 



(22) 



H,,u / O 



^■ )U + ^«^O ( ?(0) 



Items ((21]) and ([22} show that for u 6 N fc , 

(#,- u + 5>,*O ( ?(0)), 



so 



q, 



^ ( " +) (0) = U (*j,» + 5>*n™(0) 
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finishing the induction proof. Thus 



n ( f(0) = s. 



j ■ 



In particular, q* I Si so q* I = gcd(S'j), completing the proof. 



□ 



4. Elementary Power Series Systems 



4.1. General Background for Power Series Systems. Recall that R is the set of reals, 
N the set of non-negative integers, and P the set of positive integers. The following table 
gives the notations needed for this section: 



z 




Zl j ■ ■ ■ j Zm 




F 




a field 




F[[ B ]] 




set of power series A(z) = ^ u a u z u over F 




F[[z]] k 




{(4 1 (z),..,4(z)):A(z)£F[[z]]} 




F[[z]]o 




{A(z) G F[[z]] : A(0) = 0} 




[x^ m ] A(x) 




a(0) +a(l)xH ho(m)i m 




Jg(x,y) 




the Jacobian matrix of G(x, y) with respect to y 




Spec(T(x)) 




{n > : t(n) / 0}, for T(x) 6 ¥[[x}} 




Spec(T(x)) 




(Spec(T 1 (x)),...,Spec(T m (x))), for T(x) G F[[x]] m 




The following items assume F = R, the field of real numbers 


A(z) > B(z) 


says 


a u > b u for all u 




A(z)>B(z) 


says 


Ai(z) > J5i(z) for all i 




A(z) > 


says 


Ai(z) / 0, for all i 




Dom[z] 




{A(z) G R[[z]] : A(z) > 0} 




Domofz] 




{A(z) G Dom[z] : A(0) = 0} 




Domj [x,y] 




{G(x,y) G Dom [x,y] fc : J G (0,0) = 0}, where y = yi,. 


• ,2/fc 



For k > 1, the set F[[x]] fc becomes a complete metric space when equipped with the 
metric 



d(A(x),B(x)) :-- 



2- mill ldcgrcc( y A i (x)-B l (x) : l<i<fc) •£ A(x) B(x) 

ifA(x) = B(x). 



One has d(A n (x), B n (x)) — ► as n — > oo iff for all m > there is an N > such that 
[x- m ]A n (x) = [x- m ]B n (x) for n > N; that is, for n sufficiently large, the corresponding 
coordinates of A n and B n agree on their first m + 1 coefficients. The subset F[[x]]q of 
F[[x]] fc is, with the same metric, also a complete metric space. 
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Let k > 1 be given, and let y := yi,---,yk- Given a fc-tuple of formal power series 
G(x,y) G F[[x,y]]q, and given A(x) G F[[x]]q, the composition G(x, A(x)) is a well-defined 
member of F[[x]]§ if G(x, 0) = 0. (This is a sufficient, but not necessary condition.) Such 
a G(x,y) can be viewed as a mapping from F[[x]]g to itself, a mapping whose n-fold 
composition with itself will be expressed by G( n )(x, y), a well-defined member of ¥[[x, y]]g. 
More precisely, 

G(°)(x,y) = y, 
G<" +1 )(x,y) = G(i,GW(i,y)). 

The power series in the ith coordinate of G^(x,y) will be denoted by G^\x, y), that 
is, 

G W (x,y) = (G ( ?(x,y),...,G ( ftx,y)). 

The basic results on existence and uniqueness of solutions to systems hold in a quite general 
setting. When one wants to analyze the solutions or the spectra in more detail, it becomes 
beneficial to use the real field R. 

Proposition 22. Let G(x,y) G F[[x,y]] fc . // 

(a) G(0,0) = and 

(b) J G (0,0) = 

then the equational system y = G(x,y) 

(i) has a unique solution T(x) in F[[x]]q, 

(ii) T(x) satisfies the initial condition T(0) = 0, and, 

(hi) for any A(x) G F[[x]]q, one has (in the aforementioned complete metric space) 

T(x) = lim G^(x,A(x)). 

n— »oo 

If, furthermore, 

(c) F = R, 
then 

(iv) G(x,y) > => T(x) > 0. 

Proof. For A(x),B(x) G F[[x]]q the hypotheses guarantee that 

[x^ n ]A(x) = [x^ n ]B(x) => [x^ n+1 ]G(x,A(x)) = [x^ n+1 ]G(x, A(x)). 

This implies that G(x,y) is a contraction mapping on the complete metric space Domo[x], 
consequently (i)-(iii) follow. Item (iv) follows from (hi). □ 
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Definition 23. Given a power series T{x), let T = Spec(T(x)) ; the spectrum ofT{x), be 
the support of the sequence tin) of coefficients of T{x), that is, T := {n > : t{n) ^ 0}. 
Extend the definition of spectrum to k-tuples T(x) of power series by T = Spec(T(:z;)) := 
(Ti,...,T fc ). 

For T(x) G F[[x]] let m := m(T) and q := q(T), as in Definition [7J It is quite easy to see 
that the following hold: 

(a) x m is the largest power of x dividing T(x), that is, m is the smallest index n such 
that t(n) ^ 0, 

(b) x q is the largest power of x such that for n > 0, t{n) ^ implies q | n — m. 

(c) There is a (unique) power series V(x) E ¥[x] such that T(x) = x m V(x q ). One has 

gcd(y) = i. 

(d) Suppose F = R and T(x) > 0. If the radius of convergence p of T(x) is in (0, oo) then 
the dominant singularities of T(x) are p ■ , j = 0, . . . , q — 1, where u is a primitive 
qth root of unity. 

Under favorable conditions — such as those encountered in [T] , a study of non- linear single 
equation systems y = G(x, y) with solution T(x) — the spectrum T of T{x) is the union 
of a finite set and an arithmetical progression, and the coefficients t(n) of T(x) have 'nice' 
asymptotics for n on this spectrum. It would be an important achievement to show that 
any system y = G(x,y) built from standard components would have a solution T(x) with 
the Ti(x) exhibiting the positive features just described. A first, and very modest step in 
this direction, is to show that such systems have spectra of the appropriate kind, namely 
eventually periodic spectra. This positive first step is achieved in Section [5} 

4.2. Non-Negative Power Series and Elementary Systems. A power series A(z) G 
K[[z]] is non-negative if j4(z)I>0, that is, each coefficient a u is non-negative. A(z) S M[[z]] m 
is non-negative if each Ai(z) is non-negative. A system y = G(a;,y) G M[[x,y]] fc is non- 
negative if G(x,y) is non-negative. 

A non-negative power series G(x, y) can be expressed in the form 

ueN fc 

where y u is the monomial y^ 1 ■ ■ ■yt k - A non-negative system y = G(x, y) is elementary 
iff G(0,0) = Jg(0,0) = 0; this condition is easily seen to be equivalent to requiring: for 
u <E N fc and 1 < i < k, 

k 

G i)U (0) #0 => J2 u i^ 2 - 

3=1 
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When working with non-negative power series, the Spec operator acts like a homomorphism, 
as the next lemma shows. This allows one to convert equational specifications, or equational 
systems defining generating functions, into equational systems about spectra. 

Lemma 24. Let c > and let A{x),Ai{x),B{x) E ^[[^]] be non-negative power series. 
Then 

(a) Spec(c • A(x)) = A 

(b) Spec(A(x) + B(x)) = A U B 

(c) Spec\J2iM x )) = UA, provided Y,i A i{x) € R[a?] 

(d) Spec(A(x) ■ B(x)) =A + B 

(e) Spec(y4(x) o B(x)) = A* B, provided B(x) G M[x] . 

Proof. The first four cases (scalar multiplication, addition and Cauchy product) are straight- 
forward, as is composition: 

Spec(A(x) o B(x)) = Spec^ a{i)B{x) 1 = (J Spec (S(x)*) 

i>l ieA 

jgA 

□ 

One defines the dependency digraph Dq, for a system y = G(x, y) parallel to the way one 
defines it for a system of set-equations Y = T(Y), namely i — ► j iff Gi(x,y) depends on 

«?■ 

Lemma 25 (Tests for eventually dependent). Given a non-negative system y = G(x,y), 
the following are equivalent: 

(a) i j 

(b) t/iere is an m G {1, . . . , fc} suc/i t/iat t/ie (i, j) entry of Jc(x,y) m is noi 

(c) the (i,j) entry of YL,=i j g{x, y) m ?s notO. 

In practice one only works with systems that have a connected dependency digraph. Oth- 
erwise the system trivially breaks up into several independent subsystems. There has been 
considerable interest in irreducible systems, where every yi eventually depends on every yj. 
Such systems behave similarly to one-equation systems. However, even some non-negative 
irreducible systems y = G(x,y) can be easily decomposed into several independent sub- 
systems — this will happen precisely when JG{ x iy) k has some zero entries. If not, then 
JG(x,y) k > 0, which is precisely the case when the matrix Jc(x,y) fe is primitive - 
this is equivalent to the system being aperiodic and irreducible. (See, for example, [15].) 
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Awareness of the possibility of decomposing irreducible systems is important for practical 
computational work. The next result is our main theorem on power series systems. 

Theorem 26. For an elementary system y = G(x,y) the following hold: 

(a) The system has a unique solution T(x) in M[[x]]g. 

(b) T(x) > ; that is, the coefficients of each Ti{x) are non-negative. 

(c) T(x) = G (oo) (x, A(x)) := lim G (n) (x, A(x)), for any A(x) G R[[x}} satisfying 

n^oo 

A(0) = 0. 

(d) The k-tuple T of spectra Ti is the unique solution to the elementary system of set- 
equations Y = T(Y) where 

r(Y) := |J G u + u*Y. 

uGN fc 

(c) T = r(°°)(A) := lim r^(A), for any A G Su(P) fc . 

n^oo 

(f) Ti(x) = iff G ( 1\x,0) = iff T l = iff r ( { } (0) =0 iff mi = oo. 

JVow we assume that the system has been reduced by eliminating all y% for which Ti(x) = 0. 

(§) M 7^ implies Ti is periodic. If also there is a j G [i] suc/i i/iai /or some u G N fe 
one /ias Gj iU / and : 2, then Ti is the union of a finite set with a 

single arithmetical progression. 

(h) // [i] = and the i th equation can be written in the form 

k 

Yi := P l + |J Y,Qj*Yj, 

QeOi j=i 

with Pi [eventually] periodic, and with £2j a finite set of k-tuples Q = (Qi, ■ ■ ■ , Qk) of 
[eventually] periodic subsets Qj o/N, and if for i j one has Tj being [eventually] 
periodic, then Ti is [eventually] periodic. 

(i) The periodicity parameters m, q o/T can be found from r( fc )(0) and the G u via the 
formulas 

(23) m i :=m l (T l ) = min (r ( f (0)) 

(24) m-=c\(T t ) = gcd^J U (Gj,u + u*m-m j )Y 

^ ueN fe ' 

(j) qj | qj whenever i j. 
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Proof. Items (a)-(c) are immediate from Proposition 22 For (d) simply apply Spec to both 
sides of T(x) = G(x,T(x)). For (e)-(j) note that the hypotheses of the theorem imply 
that r(Y) satisfies the hypotheses of Theorem 21 so one can use the formulas (13 1 and 
(141). 



□ 



Systems that arise in combinatorial problems are invariably reduced since the solution gives 
generating functions for non-empty classes of objects. However if one should encounter 



a non-reduced elementary polynomial system y = G(x,y), Theorem 26(f) provides an 
efficient way to determine which of the solution components Tj(x) will be 0, namely let [i 
map any member A{x) £ Domo[x] to its lowest degree term, setting the coefficient to 1; 
extend this to Domo[x] fe coordinate- wise. Then 



Ti{x) = iff ((pG) (fc) (i,0)) =0. 



4.3. Periodicity Results for Linear Systems. Irreducible linear equations y = Gq{x)-\- 
G\{x)y do not, in general, have the property that the spectrum T is eventually an arith- 
metical progression. For example, let y = T{x) be the power series solution to 

y = x + x 2 + x 3 y. 

The periodicity parameters of T are m = l,q = l,p = 3, and c = 1. T is readily seen to 
be 

{3n + 1 : n > 0} U {3n + 2 : n > 0}, 
and the set of periods of T is the same as the set of eventual periods of T, namely 3-N. 

The spectrum of a 1-equation elementary linear system has a particularly simple expres- 
sion. 

Proposition 27. Given a 1-equation elementary linear system 

y = G(x,y) := G (x) + G x (z) ■ y, 

the solution is 

n>0 

the spectral equation is 

Y = T(Y) := G U(G! + y), 

and the spectrum is 



T = ((Jn*Gi)+G = G + N*Gi. 



n>0 



Thus m(T) = min(Go) and q(T) = gcd ((G - m(T)) U d) . 
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The proof of the proposition is straightforward. From the form of the solution for T one 
sees that every periodic subset of P is the spectrum of the solution to some 1-equation 
linear system. 

The next two examples, of linear systems, are cornerstones in the study of systems. 

Example 28 (Postage Stamp Problem). The postage stamp problem (an equivalent ver- 
sion is called the coin change problem) asks for the amounts of postage one can put on 
a package if one has stamps in denominations di, . . . ,d r . With D = {d±, . . . , d r } the set 
of denominations of the stamps, let D(x) = X^i=i x<ii - Then the postage stamp problem 
has the generating function S(x) (with s(n) giving the number of ways to realize the postal 
amount n) being the solution to the elementary linear recursion 

y = D(x) + D(x) ■ y. 

The spectrum S is the solution to the set-equation 

Y = D U {D + Y), 



which, by Proposition 21 is S = P* D. By Lemma \Td\ S is periodic, q = p = gcd(S') = 
gcd(D), and S = S\ <c U (c + q • N), where c := c(S), etc^ 

Example 29 (Paths in Labelled Digraphs). The objective in this example is to find the 
set of lengths of the paths going from vertex 1 to vertex 4 in the labelled digraph in Fig. [7J 




Figure 1 . A Labelled Digraph 



For 1 < i < 4, let Li(x) = Yl n >\ K n ) xn be the generating function for the lengths of paths 
going from vertex i to vertex 4, that is, £i(n) counts the number of paths of length n from 
vertex i to vertex 4. Then y = L(x) satisfies the following system y = G(x,y): 

yi = x ■ (j/ 2 + 2/3) 

V2 = x-ys 

6 The number 7(D) := c(S) is called the conductor of D by Wilf (see [23], §3.15.). 7(D) - 1 is called 
the Frobenius number, and the problem of finding it is called the Frobenius Problem (or Coin Problem). 
The problem can easily be reduced to the case that gcd(D) = 1, in which case every number > j(D) is in 
N * D, but 7(D) — 1 ^ N * D. For D a finite set of positive integers, considerable effort has been devoted 
to finding a formula for 7(D) for D with few elements. The only known closed forms are for D with 1, 2 or 
3 elements. For D = {61,62} with 2 co-prime elements , the solution is "/(D) — (61 — 1)(&2 — 1), found by 
Sylvester in 1884. Finding 7(D) is known to be NP-hard. 
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V3 = x • (y 2 + 1 + Va) 
Va = x ■ y 2 . 

One has G(x,y) > and G(0, 0) = Jg(0,0) = 0, so the system is elementary. The 
associated elementary spectral system Y = T(Y) is: 

Yi = 1 + (Y 2 UY 3 ) 

Y 2 = 1 + Y 3 

Y 3 = 1 U (1 + (Y 2 U Y 4 )) 

Y 4 = 1 + Y 2 . 

To calculate the rrij and qj /or i/izs system, first 



r(0) 





1 





r ( 2 )(0) 



2 
2 
1 





r( 3 )(0) 



{2,3} 
2 

{1,3} 
3 



r ( 4 )(0) 



{2,3,4} 

{2,4} 
{1,3,4} 
3 



thus, by (23), m = (2,2,1,3). For such a simple example one also easily finds the rrij by 
inspection — m, is the length of the shortest path in Fig. [7]/rom vertex i to vertex 4. 

To calculate the c\i let 



m * u - in,-, for 1 < j < 4. 



Then S± = {0, 1} ; 5*2 = {0}, S3 = {0,2,3}, and Sa = {0}. The digraph in Fig. [7] is, 
conveniently, also the dependency digraph of the system, and {2, 3, 4} is a strong component. 
From ([24]), q { = gcdU^*, Sj, so q 1 = gcd (S"i U S 2 U S 3 U Sa) = gcd{0, 1,2,3} = 1, and 
q 2 = q 3 = q 4 = gcd (5 2 US 3 U S 4 ) = gcd{0, 2, 3} = 1. 



4.4. Relaxing the Conditions on G(x,y). Recall that a power series system y = 
G(z,y) is elementary if (i) G(x,y) > 0, (ii) G(0,0) = and (hi) J G (0,0) = 0. 

The 'elementary system' requirement of Theorem |26|is usually true for power series systems 
y = G(x, y) arising in combinatorics — see, for example, the book [15] of Flajolet and 
Sedgewick, where most of the examples are such that x is a factor of G(x,y), a property 
of G(x, y) which immediately guarantees that the second and third of the three conditions 
holds. The second condition, G(0,0) = 0, is essential if the solution T(x) provides gener- 
ating functions Ti(x) for combinatorial classes % since, in these cases, T{ C P, so ^ Tj, 
for an i. 

Dropping the first requirement, that G(x, y) > 0, leads to a difficult area of research where 
little is known, even with a single equation y = G(x, y) — see the final sections of [1] for 
several remarks on the difficulties mixed signs in G(x, y) pose when trying to determine the 
asymptotics of the coefficients t(n) of a solution y = T{x). Such mixed sign situations can 
arise naturally, for example when dealing with the construction Set, which forms subsets 
of a given set of objects. The method developed in this paper for studying the spectra 
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of the solutions Ti{x) of a system y = G(x,y) very much depends on G(x, y) > 0, in 
particular, claiming that Spec(G u (x) • T(x) u ) is equal to G u + u*T. This equality can 
fail with mixed signs, for example, the spectrum of (1 — x) ■ (1 + x + x 2 ) is not the same 
as Spec(l — x) + Spec(l + x + x 2 ). 

Thus the discussion regarding strengthening the results of the previous sections will be 
limited to dropping the third requirement, that Jg(0, 0) = 0. This simply means that linear 
y-terms with constant coefficients are permitted to appear in the Gj(x,y), in which case a 
number of new possibilities can arise when classifying the solutions of such systems: 

(a) There may be no (formal power series) solution, for example, y = x + y. 

(b) There may be a solution, but not > 0, for example, y = x + 2y. 

(c) There may be infinitely many solutions, for example, y\ = y2, 2/2 = 2/1- 
One can express the system y = G(x, y) as 

y = G(x,0) + J G (0,0)-y + H(x,y), 

where 

k 

~K{x,y) = J^yi • HiO^y) 
i=i 

with each Hj(x,y) G R[[x,y]]o- 

The obvious approach to such a system with Jg(0, 0) / is to write it in the form 

(/- J G (0,0))-y = G(x,0)+H(x,y) 

and solve for y. 

Definition 30 (of G). Given G(x, y) > with G(0, 0) = 0, if the matrix I - J G (0, 0) has 
an inverse that is non-negative then let 

G(x,y) := (/- J G (0,0)) _1 - (g(x, 0) + H(x, y)) . 

Given a non-negative square matrix M, let A(M) denote the largest real eigenvalue of M. 
(Note: From the Perron-Frobenius theory we know that a non-negative square matrix M 
has a non-negative real eigenvalue, hence there is indeed a largest real eigenvalue A(M), it 
is > 0, and A(M) has a non-negative eigenvector.) 

Theorem 31. Let G(x,y) G M[[x,y]] fc satisfy the two conditions 

G(x,y)>0, and G(0,0) = 0. 

(a) Suppose I — J G (0,0) has a non-negative inverse. 

(i) The system y = G(x,y) is equivalent to the system y = G(x,y), that is, they 
have the same solutions (but not necessarily the same dependency digraph). 
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(ii) G(x,y) is an elementary system. 

(iii) Consequently T(x) := G(°°>(x, 0) is the unique solution in M[[x]]o of y = 
G(x,y) as well as of y = G(x,y). The periodicity properties ofT(x) are as stated 
in Theorem \2b\ 



(b) Suppose that G^ k \x, 0) > 0, that is, the associated system Y = T(Y) of set equations 
is reduced. Then the following are equivalent: 

(i) I — Jg(0, 0) has a non-negative inverse. 

(ii) y = G(x,y) has a solution T(x) 6 Domo[x]. 

(iii) A(J G (0,0)) < 1. 

Proof, (a): Given that I — Jg(0, 0) has a non- negative inverse, one can transform either of 
y = G(x,y) and y = G(x,y) into the other by simple operations that preserve solutions. 
It is routine to check that G(x,y) is an elementary system. 

(b): Assume G( fc )(x,0) > 0. (i) (ii) follows from (a). If (ii) holds then 

T(x) = G (fc) (x,T(x)) > G (fe) (x,0) > 0. 

Let v > be a left eigenvector of A(J G ( fc ) (0, 0)) . From 

T(x) = G (fc) (x,0) + J GW (0,0) -T(x) + H(x,T(x)), 

one has 

(25) v-T(x) = vG^(x,0) + A(J GW (0,0)) • v • T(x) + v-H(x,T(x)). 

Since T(x) > 0, one has v • T(x) and v • G^(x,0) + H(x,T(x)) are non-zero power 
series with non-negative coefficients, consequently ( |25[ ) implies A( J G (k) (0, 0)) < 1. From 

J GW (0,0) = J G (0,0) fe it follows that (^A( J G (0, 0))) is an eigenvalue of J G (k)(0,0), and 
thus also < 1. But this clearly implies A(Jg(0,0)) < 1, so (ii) (iii). 

If (iii) holds, then by Neumann's expansion theorem (see [T7|, p. 201), one knows that 
/ — Jg(0, 0) has an inverse, and (/ — Jg(0, 0) _1 = J2 n >o ^g(0> 0) n , a non-negative matrix. 
Thus (iii) (i). □ 

The condition G*- fc -*(x,0) > is the norm for power series systems in combinatorics since 
the Tj(x) in the solution of y = G(x,y) are generating functions for non-empty classes 

It turns out (but will not be proved here) that for the calculation of the mj and one 
can use the formulas (23) and (24) of Theorem 26 with the original system y = G(x, y) 
as well as with the derived system y = G(x,y). It can be useful to note that if the two 
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hypotheses of Theorem 31 hold, then the condition G^ k \x, 0) > is equivalent to requiring 



that G^(x,0) > hold for some j, I < j < k 

Remark 32. The uniqueness of solutions T(x) in M[[x]]q for power series systems y = 
G(x,y) satisfying the two hypotheses of Theorem does not in general carry over to 
the associated spectral systems Y = T(Y) when Jg(0,0) ^ 0. For example, consider the 
consistent single equation system y = G(x,y) where G(x,y) = x 2 + (l/2)y + xy. The 
spectral system Y = T(Y) is Y = 2UFU(1 + F), which has three solutions N ; 1 + N ; 
and 2 + N. The elementary system y = G(x, y) is y = 2x 2 + 2xy; its spectral system is 
Y = 2 U (1 + Y), which has the unique solution 2 + N. 

4.5. A Non-linear Polynomial System. The following simple example uses all the tools 
developed so far. 

Example 33. Consider the class T of planar trees with blue and red colored nodes, defined 
by the conditions: 

(i) every blue node that is not a leaf has exactly three subnodes, but not all of the same 
color; 

(ii) and every red node that is not a leaf has exactly two subnodes. 

Let B be the collection of trees in T with the root colored blue, and likewise define 1Z for 
the red-colored roots. Then, letting »b be a blue-colored node and a red-colored node, 
one has the equational specification 

to r \ i i *^ i i i i *^ i i 

l ' Bi B + TZ + TZ TZ + B + TZ TZ + TZ + B 



B + B + 1Z B + 1Z + B 1Z + B + B 
TZ = {. R } U 
T = B + 1Z. 

The three generating functions, B(x) for B, R(x) for TZ, and T(x) for T, are related by 
the system of equations: 

B{x) = x + 3x ■ B{x) ■ R{x) 2 + 3x ■ B{x) 2 ■ R{x) 
R(x) = x + x ■ T(x) 2 
T(x) = B(x) + R(x). 

Thus (B(x), R(x), T(x)) gives a solution for (yi,y2,ys) in the system of polynomial equa- 
tions: 

yi = x + 3x • yi ■ y\ + 3x • y\ ■ y 2 
y 2 = x + x ■ y 2 
2/3 = Vi + 2/2- 
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The spectra B,R,T are related by the set-equations 

B = lU(l + £ + 2* J R)U(l + 2*5 + i?) 

R = 1 u (1 + 2*T) 

T = BUR, 
so (B, R, T) is a solution to the system of set-equations 

Y 1 = 1 U l + (Y!+2*y 2 ) U (1 + 2*Y + Y 2 ) 

y 2 = i u (i + 2*y 3 ) 

Y 3 = Yi U Y 2 . 



Next, 



G{x,yi,y 2 ,y 3 ) 



x + 3x • yi ■ yl + 3x ■ y\ ■ y 2 
x + x • yl 



yi + V2 



so 



G^(x, 0,0,0) 



6x + x 
x 
2x 



> 0. 



This implies G^ k \x, 0) > 0, w/iere k = 3. 
T/ie Jacobian matrix Jc(x,y) is 

3xy| + 6xyiy 2 6xwiy 2 + 3xy^ 



Jo(x,yi,y2,y3) 





1 





1 





2xy 3 




so 



J G (x, 0,0,0) 







1 1 



The eigenvalues of Jg(0, 0, 0, 0) are the roots o/det (XI- J G (0, 0, 0, 0)) = 0, t/iat is, A 3 
T/ras A(J G (0, 0,0,0)) = < 1, so the system y = G(x,y) has a solution T(x) G M[[ 
and i/ie solution is > . T/ie inverse of I — Jg(0, 0,0,0) is a non-negative matrix: 

1 

1 

1 1 1 



(/-J G (0, 0,0,0)) 1 



Thus 



G(x,y) 



x + 3xyiy| + 3xy^y 2 
x + xy\ 

2x + 3xyiy| + 3xyfy 2 + xyf + yi + y 2 



The spectral system Y = T(Y) is 

Yi = 1 U (1 + Yi + 2 * Y 2 ) U (1 + 2 * Yi + Y 2 ) 
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Y 2 = iu(i + 2*y 3 ) 

Y 3 = 1 U (1 + Yl + 2*y 2 ) U (1 + 2*Y X + Y 2 ) U (l + 2*y 3 ) UY 1 UY 2 

5. General Systems 

Recall that 

Dom [x] = {A(x) G : A(0) = 0,A(x) > 0} 

Dom [x,y] = {G(x, y) G M[x] fe : G(x, y) > 0, G(0, 0) = 0, J G (0, 0) = 0}. 

The systems y = G(x,y) considered so far are power-series systems. However these are 
not adequate to capture the scope of the popular constructions such as MSet (multiset) 
and Cycle used in combinatorial specifications — in particular one needs MSet in the study 
of monadic second-order classes in ^6] 

If A and B are two combinatorial classes with the same generating function, that is, A{x) = 
B(x), then MSet(_4) and MSet(S) have the same generating function; likewise for the 
construction Cycle. Such constructions are called admissible in Flajolet and Sedgewick 
|15j . In the case of MSet, the generating function for MSet(^l) is 

exp(^v4(x m )/m) -1. 

m>l 

Ordinary generating functions A{x) have integer coefficients; the operator MSet is extended 
to all A{x) G Domo[x] by the same expression: 

MSet(A(a;)) := exp ( ^ A{x m )/rnj - 1. 

m>l 

This operator cannot be expressed by a power series in A(x), so specifications using MSet 
do not, in general, lead to elementary systems. 

The operations and constructions/operators considered here are (see [15] or [1]): 

(a) the constant • (a single node) corresponds to the polynomial x in generating functions 

(b) the construction union (disjoint union) corresponds to the operation of + (addition) 
for generating functions 

(c) the construction + (disjoint sum) corresponds to the operation x (product) for gen- 
erating functions 

(d) the construction/operator Seq (sequence) 

(e) the construction/operator MSet (multiset) 

(f) the construction/operator Cycle (cycle) 

(g) the construction/operator DCycle (directed cycle) 
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Items (d)-(g) are called the standard constructions. A standard construction 6 can be 
restricted to a set of positive integers J, giving the construction G j, the meaning of which 
is that &j(A) consists of all objects that one can construct by applying to only J-many 
objects from A (repeats allowed). Thus MSetE ve n(»4) gives all multisets consisting of an 
even number of objects from A. The operators J*, for JCN, are precisely the operators 
MSetj, so the star operation (★) is included in the above list. 

Definition 34. Let C be the collection of combinatorial classes. A construction 



is admissible iff: 

whenever two k-tuples of combinatorial classes A and B have the same 
k-tuples of generating functions A(x) and B(x) then the m-tuple of combi- 
natorial classes Q(A) and 0(23) also have the same n-tuples of generating 
functions. 

The operator from Domo[x] fe to Domo[x] m induced by such a construction is also designated 
by®. 

A variant of this definition is needed for the study of spectra of solutions to systems of 
equations. 

Definition 35. An operator 



The operator from Su(N) fc to Su(N) m ; where Su(N) is the set of subsets ofN, induced by a 
spectrally admissible operator is designated by T®. 

Lemma 36. Each G(x,y) £ Domjofx^]^ defines an operator on Domo[x] fe that is both 
admissible and spectrally admissible. Such operators are called elementary operators. As 
a spectrally admissible operator, G(x,y) induces a set-operator (on Su(N) fe , the set of k- 
tuples of subsets o/N), namely 



6 : C k -»■ 



■rn 



: Dom [x] fe -► Dom [x] m , 




T:A^ |J G iiU + (u*A). 



uen k 



Definition 37. Two spectrally admissible operators and 0' on Domo[x] fe are spectrally 
equivalent if they give the same set-operator, that is, for all A(x) G Domo[x] fc , 

Spec(0(A(x))) = Spec(0 / (A(a;))). 



34 JASON BELL, STANLEY BURRIS, KAREN YEATS 

The standard admissible operators (and their restrictions) map Domofa;] to itself, hence 
k = m = 1 in such cases. However the elementary operators require that one take arbitrary 
k > 1 into consideration. 

In addition to the (restrictions of the) standard constructions G being admissible, they are 
spectrally admissible. A simplifying feature of working with spectrally admissible operators 
is that they can often be better understood by replacing them with equivalent elementary 
operators. 

Theorem 38 (Systems based on Spectrally Admissible Operators). 

(a) Elementary operators G(x,y) and restrictions ©j of the standard operators are 
spectrally admissible. 

(b) The restriction Qj(y) of a standard operator is spectrally equivalent to the elemen- 
tary operator ^Jy 5 , and Spec(0j(A(x))) = J * A. 

(c) The sum @% + ©2, product @\ ■ 02 and composition @i o 2 of spectrally admissible 
operators is spectrally admissible. 

(d) Any combination of elementary operators and restrictions of standard operators - 
using the operations of sum, product and composition — yields an operator that is 
spectrally admissible and spectrally equivalent to an elementary operator. 

(e) If 0(y) is spectrally equivalent to 0'(y) then 

Spec(0(°°)(0)) = Spec(0 / (°°)(0)). 

(f) Let y = 0(y) be a system with solution T(x) G Domo[2;] fc , where the operators Oj 
are combinations as described in item (d). By (d), is spectrally equivalent to 
an elementary operator G(x,y). Let U(x) be the unique solution to y = G(x,y) 



guaranteed by Theorem 26 Then T = U. 



Thus periodicity properties for the Ti(x) can be deduced by applying Theorem 26 to 
y = G(x,y). 

Proof. Items (a) through (e) are straightforward. For item (f), the operators Oj(Y) are 
spectrally equivalent to an elementary operator by (d). From the spectral equivalence of 
the operators 0(y) and G(x,y) and the fact that T(x) is a solution of y = 0(y), one has 

T = Spec(0(T(x))) = Spec(G(x,T(x))) = T(T), 

where T is the set operator corresponding to G(x,y). So T is a solution of Y = r(Y). 
Now U(x) = G(U(x)) implies that U is also a solution of Y = T(Y). Theorem 



21 



says 



that the elementary system Y = T(Y) has a unique solution, so U = T. Consequently the 



periodicity properties of T are those of U, and thus Theorem 26 can be used to analyze 



T. □ 
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The next example illustrates the methods for determining the periodicity parameters for 
the power series solution T(x) of a general equational system y = 0(y ) using a specification 
of 'structured' treesQ where (some or all of) the nodes immediately below a node can be 
given a structure, such as a cycle or a sequence. 

Example 39. Let T be the class of two-colored (red, blue) 'structured' trees which satisfies 
the following conditions: 

(a) A red node must have a cycle consisting of a positive even number of red nodes, or 6 
blue nodes, at least 3 of the blue nodes being leaves, immediately below it; 

(b) A blue node that is not a leaf has a multiset consisting of a prime number of red 
nodes immediately below it, plus a sequence of blue nodes whose number is congruent 
to 4 mod 6. 

Letting 1Z be the members of T with a red root, and B those with a blue root, one has the 
specification 

• » •» 

K = - — —- U 



Cycle PosEven (ft) 3 m B + MSet 3 (£) 
B = {. B } U * 1! 



MSet Primes (^) + Seq 4+6 . N (£) 

T = HUB. 

The associated spectral system is 

Yi = (1 + PosEven*Yi) U (4 + 3*Y 2 ) 

Y 2 = lu(l + Primes*Yi + (4 + 6-N)*y 2 ] 

y 3 = yiuy 2 

with solution (YhY^Yj) = (R,B,T). This is not an elementary system (because of the 
linear terms in the right side of the third equation), but nonetheless the solution is unique. 
Note that {1,2} is a strong component of the dependency digraph. 

To determine the periodicity parameters for T it suffices to determine them for B and 1Z 
and apply Proposition^ since m(T) = m(R U B) and q(T) = q(R U B). The first two 
equations form an elementary system, and one has: 

(1 + PosEven*yi) U (4 + 3*y 2 ) \ 

1 U (l + Primes * Yi + (4 + 6 • N) * 



r(Yi,Y 2 ) 
r(0,0) 




1 



This additional structure on the tree can be viewed as a way of embedding a tree in 3-space, so that 
a node that covers a cycle of nodes 'looks' rather like a chandelier; perhaps one would prefer to consider 
the structure to be maintained by the legendary substance called quintessence that fixed the stars in the 
ancient heavens — it was invisible, weightless, etc. 
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r( 2 )(0,0) = 

Thus m := (mi,rri2) = (7, 1). 

Writing 



7 

1 I ' 



r i (Y 1 ,Y 2 ) = [J G i>u + (u 1 *Y 1 + u 2 *Y 2 ) 



uef 



one has 



1 if u\ G PosEven and u 2 = 
Gi, u = ^4 if u\ = and n2 = 3 
otherwise 



G 2 ,u 



1 i/ (ui = U2 = 0) or (ui G Primes and u 2 = A mod 6) 
otherwise. 



Now u *m = 7ui + ii2, so 

7u\ + u 2 — Q if {u\ G PosEven and U2 = 0) 

7ui + U2 — 3 if u± = and U2 = 3 

otherwise 



Gi u + u*ra-mi 



G2,u + u*m - m 2 



7ni + U2 if (u\ = u 2 = 0) or (u\ G Primes and U2 = 4 mod 6) 
otherwise. 



From this one has 

gcd^J (Gi iU + u*m — mi) = gcd{7ui — 6 : ui G PosEven} = 2 

u 

gcd^J (G2, u + u*m — 1TI2) = gcd{7ni + u 2 : u\ G Primes and u 2 = 4 mod 6} = 1 

u 

Since the two equation system is irreducible, that is, i j for all vertices i,j, one has 

2 

qi = c\2 = gcd|J|jG iiU + u*m-mi 

u i=l 

= gcd(2,l) = 1. 

Using Proposition^ the above calculations give 

rri3 = min(mi,m2) = min(7, 1) = 1 
q 3 = gcd(qi,q 2 ,mi - m 2 ) = gcd(l,l,6) = 1. 

In summary, (m(R),m(B),m(T)) = (7,1,1) and (q(R),q(B),q(T)) = (1,1,1). 
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6. Monadic Second Order Classes 



At present there are two major approaches to describing broad collections of combinatorial 
structures: (1) combinatorialists (see, for example, |15j ) prefer to look at specifications 
that are based on constructions like sequences, cycles and multisets, whereas (2) logicians 
prefer to look at classes that are defined by sentences in a formal logic. 

When working with relational structures like graphs and trees, logicians have found it 
worthwhile to strengthen first-order logic to monadic second-order logic (MSO logic) J^] 
The primary reason for the interest in MSO logic is the powerful connection between 
Ehrenfeucht-Frai'sse games and sentences of a given quanifier rankQ These games, although 
very combinatorial in nature, are not widely used in the combinatorics community 

6.1. Regular Languages. A set C of words over an m-letter alphabet is a regular language 
if it is precisely the set of words accepted by some finite state deterministic automaton. A 
word is accepted by such an automaton if, starting at state 0, one can follow a path to a 
final state with the successive edges of the path spelling out the word. Let the states of the 
automaton be So, ■ ■ ■ , Sk, and for each state Si let L% be the set of words traversed when 
going from vertex % to a final state vertex. Then one sees that d is the union of the classes 
aijCj where i —* j is an edge in the automaton labeled by the letter aij from the alphabet. 
This leads to equations of a particularly simple form for the generating functions and the 
spectra, namely for 1 < i < k, 



One of the first big successes for MSO was Biichi's Theorem connecting the regular lan- 
guages studied by computer scientists with classes of colored digraphs defined by MSO 
sentences. To see how this connection is made, simply note that a word on m letters cor- 
responds to an m-colored linear digraph (D, — Ci, . . . , C m ), and thus a language on an 
m-letter alphabet can be thought of as a class of m-colored linear digraphs. 

Theorem 40 (Biichi [5_, 1960). MSO classes of colored linear digraphs are precisely the 
regular languages. 

The theory of the generating functions for MSO classes of colored linear digraphs was 
worked out, in the context of regular languages, by Berstel [3J, 1971 (his results were soon 

^This is just first-order logic augmented with unary predicates U as variables — this means that one can 
quantify over subsets as well as individual elements, and say that an element belongs to a subset. The fact 
that the U are predicates and not domain elements make the logic second-order, and the fact that these 
predicates have only one argument (e.g., U(x)) makes the logic monadic. 

9 The connection with Ehrenfeucht-Frai'sse games fails if one has quantification over more general rela- 
tions, like binary relations. 




Li 



^u(i+U^). 



»-+?' 
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augmented by Soittola [21], 1976). Given a regular language 1Z, one can partition it into 
classes IZj such that the generating functions Ri{x) satisfy a system of linear equations 
y = x(C + M ■ y), where C is a 0,1-column matrix, and M is a 0,1-square matrix. The 
equations are easily read off a finite state deterministic automata that accepts the language; 
one writes down a system of equations for the paths in the automata, similar to the situation 
in Example [29] The equations have a particularly simple linear form — the spectra Ri are 
eventually periodic, and by Cramer's rule, the generating functions Ri{x) are rational 
functions; also they are given by R(x) = x ■ \I — iM) • C. Berstel showed that each 
Ri(x) decomposes into a finite number of Rjj(x), each Rij being either finite or eventually 
an arithmetical progression. For those which are not finite there are polynomials Pjjfc(n) 
and complex numbers fiyk = Pij ■ u>^ , with j3jj a positive real and ojy a root of unity, such 
that, on the set Rij, one has the coefficients r,j(n) having an exact polynomial-exponential 
form, and polynomial-exponential asymptotics, given by (see [15], p. 302): 



This study of the generating functions for MSO classes of colored linear digraphs provides 
the Berstel Paradigm, a successful analysis that one would like to see paralleled in the study 
of all MSO classes of colored trees. For example, can one show that the generating functions 
T{x) of such classes decompose into a polynomial and finitely many "nice" functions Tj{x), 
with each spectrum T, being an arithmetical progression? 



6.2. Trees and Forests. When speaking of structures, in particular the models of a 
sentence ip, it will be understood that only finite structures are being considered. 

A tree T = (T, <) is a poset such that: (i) there is a unique maximal element rt(T) called 
the root of the tree, and (ii) every interval [a, rt(T)] is linear. A forest F = (F, <) is a 
poset whose components are trees. 

A forest F is determined (up to isomorphism) by the number of each (isomorphism type 
of) tree appearing in it, thus by its counting function v-p : TREES — > N. 

One can combine two forests Fi and F2 into a single forest Fi + F2 which is determined 
up to isomorphism by = uy 1 + ^f 2 • Extend this operation to classes J- of forests by 
T\ + T% = {Fi + F2 : Fj G Ti\. The ideal class O of forests is introduced with the 
properties O U J- = O + T = J- (it is introduced solely as a notational device to smooth 
out the presentation). 




on the set Rij 



k 



on the set Rij. 
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Define the operation * between non-empty subsets A of N and non-empty classes T of 
forests by 



n-k J- 



A-kT 



O if ra = 

T + ■ ■ ■ + T if n > 1 



n— fold 



aeA 



6.3. Compton's Specification of MSO Classes of Trees. Fi =^ b ° F2 means that 
Fi and F2 satisfy the same MSO sentences of quantifier rank q. =^ so is an equivalence 
relation on T of finite index. In the following, when given a MSO class T of forests, 
it will be assumed that q has been chosen large enough so (i) J- is definable by a MSO 
sentence of quantifier depth q, and (ii) that there are MSO sentences of quantifier depth 
q to express "is a tree", "is a forest". Then TREES is a union of =^ ISO classes of forests, 
say TREES = T\ U • • • U %■. If % has a 1-element tree in it then no other tree is in %. 
Assume that there are m colors, and let denote the 1-element tree of color i, and assume 
% = {»i} for 1 < i < m. These are the only % with a one-element member, and all trees 
in any given % have the same root-color, say i! . 

Given a tree T with more than one element, let dT be the forest that results from removing 
the root rt(T) from T; and given any forest F, let •i/F be the tree that results by adding 
a root of color i to the forest. The operation d is extended in the obvious manner to dT 
for any non-empty class T of trees that does not have a one-element tree in it; and the 
operation of adding a root of color i to a forest is extended to •i/J- for any non-empty 
class J- of forests. 

Lemma 41. Let q be a positive integer. 

(a) The operations of disjoint union and preserve =^ /IS0 , that is, 

i i 

F ^ MS0 F' .i/F ^ MS0 .i/F', forl<i<m. 

(b) There is a constant C q such that for all trees T and all n > C q one has n-kT =^ /IS0 
C q *T. 

(c) There is a decision procedure to determine if Fx =^ so F 2 . 



Proof. One can find a discussion of the first item of (a), as well as item (b), in [6], based on 
E-F games. Use E-F games for (c) as well, (a)-(c) are basic tools of Gurevich and Shelah 
(dS|, 2003). □ 



40 JASON BELL, STANLEY BURRIS, KAREN YEATS 

The next lemma gives the crucial structure result for MSO classes of forests. 

Lemma 42. Let T be a MSO class of forests defined by a sentence of quantifier rank q. 
Then there is a finite set S of r-tuples S = (Si) of cofinite or non-empty finite subsets Si 
o/N such that 



* = U E S i* T r 
sen j=i 

Proof. Let C q be as in Lemma [411 A routine application of Ehrenfeucht-Fraisse games 
shows that for any two r-tuples (n^) and (raQ of non-negative integers with rtj > C q iff 
> C q , one has every member of ni-k% equivalent modulo =^ so to every member of 

Thus T decomposes into a (disjoint) union of finitely many classes YH=i ^i*Ti where each 
Si is either a singleton {ni} with 1 < m < m or the cofinite set {n : n > C q }. □ 

Lemma 43. For m < i < r, the class of forests d% is definable by a MSO sentence of 
quantifier rank q. 

Proof. d% is closed under =^ so since Lemma 41 shows Fi =^ so F2 implies •i/'Fi =^ ISO 
•i/P 2j thus Fi =^ so F 2 and Fi 6 d7~ imply F 2 e d%. □ 

Theorem 44 (Compton, see [3]). £e£ T be a class of m- colored trees defined by a MSO 
sentence of quantifier depth q. Then: 

(a) T is a union of some of the %, and 

(b) the % satisfy a system of equations 

' Ti = *i(Ti,...,7;) 
s <? : < i 

t % = Z> r (T 1 ,...,T r ), 
where $,(7i, . . . is f° r ^ < i < m, and for i > m it has the form 

(26) . v I UE^^ 

7 5eSi 3=1 

wnt/i each Sj fremg a /imie set of r-tuples S = (S±, . . . , S r ), with each Sj a cofinite or 
non-empty finite subset o/N. 



Proof, (a) is obviously true. For (b) note that for m < i < r, % = •i/dTi. Lemma 43 
says d% is definable by a MSO sentence of quantifier rank q. Then Lemma 42 shows that 
d% can be expressed in a particular form. One only needs to attach the root to have 
(1261. □ 
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Applying Spec to S g gives a system of set-equations for the spectra of the classes %: 



Corollary 45. For T as in Compton's Theorem, Spec(T) is a union of some of the 
Spec(7i) ; and 



(27) 



Spec(7^) 



for 1 < i < m 



W + U Yl S 3 * S P ec ( T i) form<i<r. 
Ses l j=i 



Remark 46. Compton [9] described his equational specification for the minimal MSO 
classes of trees of quantifier depth q to Alan Woods during a visit to Yale in 1986; at 
the time Woods was a PostDoc at Yale. Evidently Compton regarded such an equational 
specification for trees as a straightforward generalization of the earlier work of Biichi, which 
showed that regular languages were precisely the MSO classes of m- colored linear trees. 



6.4. The dependency digraph of E ? . The dependency digraph D q for S g is defined 
parallel to the definition for systems of set-equations. D q has vertices 1, . . . , r and, referring 
to (27), directed edges given by i —> j iff there is a S G §» such that Sj ^ {0}. One defines 
a height function on D q by setting h{i) = for 1 < i < m, and then for m < i < r use the 
inductive definition h(i) = 1 + max{/i(j) : i j, but not j — > + i}. 

Corollary 47. The spectrum of a MSO class T of m-colored trees is eventually periodic. 



Proof. It suffices to prove this result for the % in view of Lemma |6] (which guarantees 
that eventual periodicity is preserved by finite union). For 1 < i < m this is trivial. So 
suppose m < i < r, and note that whenever j ^ k one has Spec(7j) 5 Pjk + Spec(7fc) for 
some positive integer pj^, by ( |27[ ). Thus i j implies the same conclusion. If [i] ^ 
then i — > + i, so Spec(7i) j) p + Spec(7i) for some p £ P, so Spec(7^) is actually periodic. 
If [i] = then one argues, by induction on the height h(i), that Spec(7^) is eventually 
periodic. The ground case, h{i) = 0, holds precisely for 1 < i < m, and in these cases 
Spec(7i) = {1}, an eventually periodic set. Now suppose the result holds for h(i) < n. If 
h{i) = n + 1 then m < i < r, and one has 

r 

Spec(^) = {!}+ (J E^SP^) 

S&Si j=l 

For the j such that there is an S with Sj ^ {0} (there is at least one such j since i > m) 
one has i — > j, so h(j) < h(i), implying Spec(Tj) is eventually periodic (by the induction 
hypothesis). The Sj are either cofinite or non-empty finite, and therefore eventually peri- 
odic. Then Lemma [6]shows Spec(7i) is eventually periodic, since being eventually periodic 
is preserved by finite unions, (finite) sums, and *, with the additional information that 
those % belonging to a strong component are actually periodic. □ 

Corollary 48. The spectrum of a MSO class T of m-colored forests is eventually periodic. 
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Proof. Since *\j T is a MSO class of trees one has {1} + Spec(.F) eventually periodic, hence 
so is Spec(^ r ). □ 

Theorem 49 (Gurevich and Shelah [16J, 2003). LetlA be a MSO class of m-colored unary 
functions. Then the spectrum Spec(W) is eventually periodic. 

Proof. It suffices to show that one can find an MSO class of m-colored forests with the 
same spectrum. Let T be the class of m-colored forests defined as follows: 

for each forest in the class there exists a subset V of the forest, with exactly 
one element from each tree in the forest, such that if one adds a directed edge 
from the root of each tree in the forest to the unique node of the tree in V, 
then one has a digraph which satisfies a defining sentence of U. 

Clearly this condition can be expressed by a MSO sentence, so Spec(.F) is eventually 
periodic; hence so is Spec(^). □ 

Although the proof of the Gurevich and Shelah Theorem comes after considerable develo- 
ment of the theory of spectra defined by equations, actually what is needed for this proof, 
beyond Compton's Theorem, is Lemma |6j This theorem is almost best possible for MSO 
classes — for example, one cannot replace 'unary function' with 'digraph' or 'graph' as one 
can easily find classes of such structures where the theorem fails to hold. The converse, 
that every eventually periodic set S C P can be realized as the spectrum of a MSO sentence 
for unary functions is easy to prove. 

In a related direction one has the following : 

Corollary 50. A MSO class of graphs with bounded defect has an eventually periodic 
spectrum. 

Proof. A connected graph has defect d if d + 1 is the minimum number of edges that need 
to be removed in order to have an acyclic graph. Thus trees have defect = -1. A graph 
has defect d if the maximum defect of its components is d. For graphs of defect at most d, 
introduce d + 2 colors, one to mark a choice of a root in each component, and the others to 
mark the endpoints of edges which, when removed, convert the graph into a forest. For an 
MSO class of m-colored graphs of defect at at most d, carrying out this additional coloring 
in all possible ways gives an MSO class of m + d + 2 colored graphs. Then removing the 
marked edges from each graph converts this into a MSO class of m + d + 2 colored forests 
with the same spectrum. □ 

This can be easily generalized further to MSO classes of digraphs with bounded defect, 
giving a slight generalization of the Gurevich-Shelah result (since trees have defect — 1, 
unary functions have defect 0). These examples suffice to indicate the power of knowing 
that monadic second-order classes of trees have eventually periodic spectra. The method 
of showing that MSO spectra are eventually periodic by reducing them to trees has been 
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successfully pursued by Fischer and Makowsky in p3] (2004), where they prove that an 
MSO class that is contained in a class of bounded patch-width has an eventually periodic 
spectrum. In the same year Shelah [19] proved that MSO classes having a certain recursive 
constructibility property had eventually periodic spectra, and in 2007 Doron and Shelah 
[TT] showed that the bounded patch-width result was a consequence of the constructibility 
property. 



6.5. Effective Tree Procedures. What follows is a program, given q, to effectively find 
a value for C q and representatives of the =^ so classes of TREES and of FORESTS, with 
applications to the decidability results of Gurevich and Shelah ([IB], 2003), and an effective 
procedure to construct Compton's system of equations for trees. The particular classes of 
trees constructed in the WHILE loop of this program are similar to the classes used 
in 1990 by Compton and Henson to prove lower bounds on computational complexity (see 

hdi, p. 38). 

Program Steps Comments 



FindReps :- 

?q :=0 



PROC(g) 



% ■= {«i, 

/(0) := 

U(0) := 1, 
t(0) := m 
(2(0) := 1 
n := 



*} 



1 < % < m 



q is the quantifier depth 
Initialize collection of forests 
Initialize collection of trees 
with root color i 
Initialize collection of trees 
cardinality of T / =™ so 
cardinality of T ifi / = fl MS0 
cardinality of To/ 
initialize d{n) 
initialize n 



-MSO 



WHILE f(n) > f(n 
n := n + 1 



1) OR d{n) > DO 



•F n '~ 


-- { m T*T 


m T < re | 






Ter n _i 




T ■ 


= {•0 U {•i/F 


: F G T n ] 


T n := 




n U ■ " U T m n 




U{n) 




\n- 1 —MSO 1 

\ 1 i,nl — q 




t{n) : 




i-f I _MSO 1 

J n/ ~ q 




f(n) 




<r 1 —MSO 1 
•Tn/ —q 




d{n) 




{TeT n :(n- 


1)*T iiq n*T} 



augment the value of n 
make forests using at most n copies 
of each tree in T n -\ 

add root of color i to forests in T n 
T n has all trees created so far 

# of =^ /IS0 classes represented by % jU 

# of =^ /IS0 classes represented by T n 

# of =^ so classes represented by T n 

# of failures of (n - 1) ★ T =^ so n*T 
for T G T n 



END WHILE 
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Define C q := n — 1 

Choose a maximal set Pl.EPtrees : = {Ti, ■ ■ ■ ,T)~} 

of =^ so distinct trees T, L from T Cq . 
Choose a maximal set -R-EPforests := {Pi, . . . , F^} 

of =^ /IS0 distinct forests Fj from J~c q - 
RETURN (AT^EPtrees^^orests) 
END PROC 

Theorem 51. The procedure FindReps(g) halts for all g£N, giving an effective procedure 
to find a set PPPtrees of representatives for the =m so equivalence classes of (finite) trees, 
a set P-EPforests of representatives for the =^ so equivalence classes of (finite) forests, 
and a number N such that for any tree T and n > N one has n*T =^ so N * T. 

Proof The classes J- n and T n are non-decreasing, every (finite) forest is in some T n , and 
every (finite) tree is in some T n . 

Based on comments in the introduction, let P q be the (finite) number of =J^ S0 classes of 
finite forests, and let C q be such that n*T =M S0 C q * T, for any tree T. 

Since f{n) is non-decreasing and < P q , there is an R q such that for n > R q one has 
f(n) = f(R q ). 

For n > C q one has d{n) = 0. 

So for n > max(C (? , Rq), the WHILE condition must fail to hold. Thus the looping process 
in the procedure FindReps halts for some n < max(C q , R q ). 



Since the number N returned by the procedure is such that f(N) = f(N—l) and d(N) = 0, 
every forest in F N+ i is =^ so to one in T N , so f(N + 1) = f(N). Then t(N + 1) = t(N) 
and d(N + 1) = 0. 

By induction one has 

(/(AT) = /(TV - 1) A d(N) = o) (Vn > N) (f(n) = f(N) A t(n) = t(N) A d(N) = o) . 

Consequently has representatives for all =^ so equivalence classes of forests, and Tn has 
representatives for all =^ /IS0 equivalence classes of trees, and N has the desired property 
of functioning as a value for C q . 

The procedures for constructing the classes T n , %, n , and T n are effective, as are the calcu- 
lations of the functions f(n), U(n), t(n) and d(n). □ 



Further Conclusions: 
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(a) The trees in T n are all of height < n, h(n) = • • • = t m (n), and t(n) = t\(n) + • • • + 
tm{n) = m ■ ti(n). 

(b) One can effectively find MSO sentences cpi, 1 < i < k, such that (pi defines [Ti] q , the 
=MSO equivalence class of trees of with the representative T, in it. 

(Just start enumerating the sentences (p and test each one in turn to see if (3i)(\/j) (Tj \= 
ip i = j). If so then i is unique; if no sentence had been previously found that 
defined [Ti] q , then let ipi := ip.) 

(c) Likewise for 1 < j < £ one can effectively find ipj defining [Fj] q , the =^ so equivalence 
class of forests with Fj in it. 

(d) (Gurevich and Shelah, p 2003) The MSO theory of FORESTS is decidable. (Given 
ip, it will be true of all forests iff it is true of each Fj in -R-E-Pforests-) 

(e) (Gurevich and Shelah, |16j 2003) Finite satisfiability for the MSO theory of one 
m-colored (finite) unary function is decidable. (This can be proved directly, by 
interpretation into FORESTS.) 

(f) One can effectively find the Compton Equations S 9 for the =^ /IS0 equivalence classes 
of m-colored trees, namely one has 

[Ti] q = {»j} ifTj = {»j}; otherwise 

k k 

[Ti\ q = U{*V^ 7j * [T?]9 : 7,e{l,...,iV-l,(>iV)}, T t ^ so .^^13*^}. 

To test the last condition (concerning =J /IS0 ) one replaces any 7i = (> N) by N, so 
one is deciding =^ so between two trees. 

(g) One can effectively find the dependency diagraph of X q (immediate from the previous 
step). 

(h) One can effectively find the periodicity parameters (as defined in [1]) of the spectra 
of the [Ti] q . 

Question 1. One questions stands out, namely can one find an explicit bound (in terms 
of known functions, like exponentiation) for the value n = N + 1 for which the WHILE 
loop halts? This would give an upper bound on the height of a set of smallest possible 
representatives of the =J^ S0 classes of trees. 

In conclusion, a strong point in favor of Compton's approach, besides its simplicity in 
proving the foundational result on the spectra of MSO classes of trees, is that it also 
gives a defining system for the generating functions, and hence offers the possibility of 
understanding the periodicity parameters described in Definition [7] and the asymptotics for 
the growth of MSO classes. Using Compton's equations we have carried out a detailed study 
[3] of MSO classes T of trees whose generating function T{x) has radius of convergence 
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p = 1. One conclusion obtained was that if the class of forests dT is closed under addition, 
and under extraction of trees (thus forming an additive number system as described in [6 J ) , 
then T has a MSO 0-1 law. 
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